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AMENDMENT Dated Jan. 7, 201 0 

TO NON-PROVISIONAL UTILITY PATENT 
APPLICATION NO 10/626,888 

TITLE OF INVENTION 

Voice, Lip-reading, Face and Emotion Stress Analysis, Fuzzy Logic Intelligent 
Camera System 
CLAIM OR CLAIMS 

The embodiments of the invention in which an exclusive property is claimed 
are defined as follows: 

Please delete claims 1 to 139 in their entirety. 

Please amend this application to include the following "NEW" claims: 140 to 159. 

1 . A security camera means observational system comprising: 

a) a local controller, hardware, software, firmware and fuzzy logic 
including wireless or wired communications interface for 
communicating with a central controller facility; 

b) a camera audio and video recording device connected to said local 
controller for observing and recording and communicating to said 
central controller; 

c) a central controller with hardware, software, firmware and fuzzy 
logic for database storage and analyses of images and sounds 
from observed actions, appearances, activities, speech and 
movements of objects, animals, persons and surroundings within 
view and listening of the said camera device as communicated from 
said camera devices; 

d) a central controller with hardware, software, firmware and fuzzy 
logic for accessing both real-time data and historic data from 
related databases from sources of governments, of multimedia 
news agencies, of associated data for the purpose of conducting 
analyses for assessment and detection of threat or potential threat; 
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e) an input device connected to said local controller for reading from 
or writing to magnetic or electronic storage data means and/ or a 
manually entering data means for input to said local controller; 

f) an output device associated with said local controller for displaying 
visually or audibly or in printed means for presenting a selection of 
information and threat analysis results received from said central 
facility controller; 

g) a camera movement device and interface to the local controller for 
three axis pointing, focusing/ zooming and turn on/ off control of the 
said camera device. 

2. A system as defined in claim 1, said input device including a "closed 
circuit" security camera and microphones, with magnetic tape recording 
and computer database data storage means, and a plurality of sensors, 
coupled to the local controller for providing information on a plurality of 
parameters related to the local area observed- 

3. A system as defined in claim 2, said sensors including a plurality of 
motion, heat, sound, vibration and air quality sensors for detection of 
people, animals, things or actions that are not of the regular normal 
occurrence or could pose a threat. 

4. A system as defined in claim 3, said actions are such as not to normally 
occur and thus are unusual and in the security sense, warrant examination 
more closely, and said threat is a thing, person, animal, action, sound, 
speech or perpetrated act that could be interpreted as a danger to a place, 
person, thing, entity, government or country. 

5. A system as defined in claim 2, said local controller including an input 
keyboard, key pad, touch screen manual device, a magnetic card or smart 
card reader/ writer, a display, a voice I/O interface, and interface means. 
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6. A system as defined in claim 2, said local controller including an output 
device being a computer video screen and speaker and indicator lights 
and printing means, magnetic or smart card recorder means, for providing 
or indicating information regarding validity or acceptance of a request for 
entrance or access or purchase based on analyses by said central 
controller. 

7. A system as defined in claim 5, said magnetic card being a ticket including 
a magnetic strip on which can be recorded the place, event, date and 
access permitted the holder of said ticket. 

8. A system as defined in claim 5, said magnetic card being a credit or 
identity card for purpose of identifying the cardholder and/ or allowing 
cardholder to access or attend a place and/ or event. 

9. A system as defined in claim 5, said smart card being an electronic 
information or debit card for purpose of identifying the cardholder and/ or 
allowing cardholder to access or attend a place and/ or event. 

10. A system as defined in claim 6, said printing means including printing on 
paper and/or printing on a ticket for access or attendance to a place and/ 
or event 

11. A system as defined in claim 10, said printing on said ticket including 
indication of no access or no attendance or no purchase using printing of 
wording such as "VOID". 

12. A system as defined in claim 1, said central controller monitoring and 
storing in databases the information communicated by the local controller, 
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the data from the local camera and sensor means and analyzing this 
information and comparative information from related databases. 

13. A system as defined in claim 1, said central controller analyses includes a 
plurality of analyses logic including the use of fuzzy logic and comparisons 
accessing related databases of stored previous visual data such as faces 
of persons, and/ or audio data such as speech, voice to text conversion, 
and/ or text data such as key words or phrases from which the system 
using fuzzy logic matches those aspects of the current observations for 
the purpose of assessing the existence of a threat or potential threat. 

14. A system as defined in claim 13, said central controller analyses 
accessing said related databases including sources of government 
systems, of multi-media news systems and of associated systems. 

15. A system as defined in claim 1, said central controller analyses includes a 
plurality of analyses logic including the use of fuzzy logic and comparisons 
accessing "live" real-time related database sources of visual data such as 
faces of persons, and/ or audio data such as speech, voice to text 
conversion, and/ or text data such as key words or phrases from which the 
system using fuzzy logic matches those aspects of the current 
observations for the purpose of assessing the existence of a threat or 
potential threat 

16. A system as defined in claim 15, said central controller analyses 
accessing said "live" real-time related databases including sources of 
government systems, of multi-media news systems and of associated 
systems that are constantly and continuously being updated in real-time. 

17. A system as defined in claim 1, said central controller analyses includes a 
plurality of analyses methods including voice stress, emotion stress, 
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actions and movement interpretation, image matching, speech/ voice to 
text conversions, lip reading to text conversion, deep extraction of 
information from text, facial identity matching, voice identity matching and 
personal data matching and comparisons accessing live real-time related 
database sources of visual data such as faces of persons, and/ or audio 
data such as speech, and/or text data such as key words or phrases from 
which the system using fuzzy logic matches those aspects of the current 
observations for the purpose of identifying people, animals, things, 
actions, speech, and stress that indicate the existence of a threat or 
potential of a threat. 

18. A system as defined in claim 17, said central controller analyses 
accessing said "live" real-time related databases including sources of 
government systems, of multi-media news systems and of associated 
systems that are constantly and continuously being updated in real-time. 

19. A system as defined in claim 1 , said central controller analyses includes a 
plurality of analyses methods including voice stress, emotion stress, 
actions and movement interpretation, image matching, speech/ voice to 
text conversions, lip reading to text conversion, deep extraction of 
information from text, facial identity matching, voice identity matching and 
personal data matching and comparisons accessing stored related 
database sources of stored previously of visual data such as faces of 
persons, and/ or audio data such as speech, and/ or text data such as key 
words or phrases from which the system using fuzzy logic matches those 
aspects of the current observations for the purpose of identifying people, 
animals, things, actions, speech, and stress that indicate the existence of 
a threat or potential of a threat. 
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20. A system as defined in claim 19, said central controller analyses 
accessing said stored related databases including sources of government 
systems, of multi-media news systems and of associated systems. 

21. A system as defined in claim 1, said security camera means system can 
include a plurality of such systems each of which can be observing the 
same or different said images and sounds from observed actions, 
appearances, activities, speech and movements of objects, animals, 
persons and surroundings and from the same or different locations, all of 
which can communicate with the said central facility controller. 

22. A system as defined in claim 1, said central controller can communicate to 
the local controller of said camera means commands for said pointing 
focusing/ zooming, viewing direction, viewing zoom magnification and 
turning on/ off camera controls. 

23. (Delete) A system as defined in claim 1, said central controller can 
communicate to any of said plurality of said security camera means 
systems 7 local controllers, as defined in claim 21, of said camera means, 
said commands for said pointing focusing/ zooming viewing direction, 
viewing zoom magnification and turn on/ off of camera and/ or controls. 

24. (Delete) A system as defined in claim 1, said central controller can 
communicate to any of said plurality of said security camera means 
systems' local controllers, as defined in claim 21, for the said purpose of 
receiving observational data for storage, as defined in claim 12, and some 
of or all of said analyses as defined in claims 13, 14, 15, 16, 17, 18 t 19 
and 20. 

25. (Delete) A system as defined in claim 1, said central controller can 
communicate to any of said plurality of said security camera means 
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systems 1 local controllers, as defined in claim 21, for the said purpose of 
receiving observational data for storage, as defined in claim 12, and some 
of or ail of said analyses as defined in claims 13, 14, 15, 16, 17, 18, 19 
and 20, with the results of said analyses said central controller can learn 
what is occurring in said observations by comparing observations from a 
plurality of the said security camera means such that the central controller 
can make decisions for said commands to be communicated to selected 
security camera means, as defined in claim 22, for the purpose of 
conducting more detailed observations thereby permitting the central 
controller to further conduct more detailed analyses. 

26. (Delete) A system as defined in claim 1, said central controller, if from its 
said analyses as defined in claims 13, 14, 15, 16, 17, 18, 19 and 20, it has 
concluded that said actions or posed threat exists, the said central 
controller can communicate the actions or threat so concluded to the 
appropriate security personnel and facilities for which the system, as 
defined in claim 1, has been established. 

27. (Delete) A system as defined in claim 1, located at the entrance or gate to 
a facility, such as a sports arena, said system with a card reader/ writer, 
as defined in claim 2, for the purpose of reading from said facility, an 
entrance/ performance attendance ticket, having a magnetic recording 
strip, as defined in claim 7, or other recording means, as defined in claim 8 
and claim 9, having read the said information stored on said magnetic 
recording strip or recording means and observing from said sensor as 
defined in claim 3, information as defined in claim 4, for storage by the 
local controller, can carryout communications of said information to said 
central controller for recording and storage of said information and for said 
central controller to conduct analyses for determination whether to allow or 
deny entrance by the holder of said ticket after which, the said 
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actions and movement interpretation, image matching, speech/ voice to 
text conversions, lip reading to text conversion, deep extraction of 
information from text, facial identity matching, voice identity matching and 
personal data matching and comparisons accessing live real-time related 
database sources of visual data such as faces of persons, and/ or audio 
data such as speech, and/or text data such as key words or phrases from 
which the system using fuzzy logic matches those aspects of the current 
observations for the purpose of identifying people, animals, things, 
actions, speech, and stress that indicate the existence of a threat or 
potential of a threat. 

18. A system as defined in claim 17, said central controller analyses 
accessing said "live" real-time related databases including sources of 
government systems, of multi-media news systems and of associated 
systems that are constantly and continuously being updated in real-time. 

19. A system as defined in claim 1, said central controller analyses includes a 
plurality of analyses methods including voice stress, emotion stress, 
actions and movement interpretation, image matching, speech/ voice to 
text conversions, lip reading to text conversion, deep extraction of 
information from text, facial identity matching, voice identity matching and 
personal data matching and comparisons accessing stored related 
database sources of stored previously of visual data such as faces of 
persons, and/ or audio data such as speech, and/ or text data such as key 
words or phrases from which the system using fuzzy logic matches those 
aspects of the current observations for the purpose of identifying people, 
animals, things, actions, speech, and stress that indicate the existence of 
a threat or potential of a threat. 
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determination is communicated by the central controller to the said local 
controller for display on output devices as defined in claim 6. 

28. (Delete) A system as defined in claim 1, located at the entrance or gate to 
a facility, such as a sports arena, said system with a card reader/ writer, 
as defined in claim 2, for the purpose of reading from said ticket having a 
magnetic recording strip as defined in claim 7, or other recording means, 
as defined in claim 8 and claim 9, or printing means as defined in claim 10 
and claim 11, having read the said information stored on said magnetic 
recording strip or recording means for storage by the local controller and 
communications of said information to said central controller for recording 
and storage of said information and said central controller conducts 
analyses for determination of allowed alcohol limit after which said 
determination is communicated by the central controller to the said local 
controller for display on output devices as defined in claim 6 and includes 
writing to the said magnetic recording strip or recording means or printing 
on said ticket with said printing means, the alcohol limit with the initial 
purchased alcohol amount indicating zero purchased. 

29. (Delete) A system as defined in claim 1, located at a concession or sales 
facility, such as a beer selling counter, said system with a card reader as 
defined in claim 2 for the purpose of reading from said ticket having a 
magnetic recording strip as defined in claim 7, the said information stored 
on said magnetic recording strip for storage by the local controller and 
said system with an input device as defined in claim 5 for entry of and/ or 
request by said holder of said ticket for the purchase of a specific amount 
of alcohol, such as beer, and the communications of said information to 
said central controller for recording and storage of said information can 
carryout analyses for determining total amount of alcohol purchased 
including current request and all previous requests recorded to that ticket 
and using fuzzy logic comparing said total to limit amount recorded on 
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said ticket can determine to allow or deny, according to being under or 
over said limit, the said purchases by the holder of said ticket after which 
said determination is communicated by the central controller to the local 
controller for display on output devices as defined in claim 6 including, if 
purchase is denied, printing "VOID" on the said ticket and/ or recording 
"NO SALE" on the said magnetic strip of said ticket and/ or displaying "NO 
SALE" on said output computer video display screen, and/ or in voice over 
said speaker saying "NO SALE 77 , and said central controller also 
communicated to local controller of a camera means defined in claim 1, 
which is located such that it is capable of observing the seat location 
indicated on said ticket. 

30. A system as defined in claim 2, said input device including a "closed 
circuit" security camera and microphones such that the microphones are 
arranged so that one detects sounds originating in from front of the 
camera and the other detects sounds originating from behind the camera. 

31. (Delete) A system as defined in claim 1 with said microphones as defined 
in claim 2 and claim 30 interfaced to said local controller defined in claim 
2, with said local controller having fuzzy logic capable of detecting sound 
from said microphones said local controller can determine the direction of 
said sound and with such determination the local controller being able to 
command the said camera means controls for pointing, focusing/ zooming, 
viewing direction, viewing zoom magnification and turning on/ off camera 
said local controller can command the said camera means to observe 
what is in the direction from which the sound originated and to report 
those observations to the said central controller defined in claim 1 . 

32. (Delete) A system as defined in claim 1 with said microphones as defined 
in claim 30 interfaced to said local controller defined in claim 2, with said 
local controller having fuzzy logic capable of detecting sound from said 
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microphones can communicate that sound to the central controller for 
analyses determining the speech, text, and meaning of key phrases and 
words, such as "bomb" and if such analyses detects a threatening phrase 
or word, the central controller fuzzy logic can decide to instruct the local 
controller to command the said camera means controls for pointing, 
focusing/ zooming, viewing direction, viewing zoom magnification and 
turning on/ off camera with which said commands the said camera means 
can observe what action or actions is or are occurring in the direction from 
which the text originated and to report those observations to the said 
central controller defined in claim 1. 

33. A system as defined in claim 1, said local controller incorporates part or all 
of said central controller functions and capabilities such that the said 
camera means could be a stand alone complete Camera System means 
utilizing microelectronic designs, circuitry miniaturization and solid state 
memory systems. 

34. A system as defined in claim 1, said local controller utilizing fuzzy logic 
and microelectronic designs, circuitry miniaturization and solid state 
memory systems, incorporates part or much of the said central controller 
functions and capabilities such that the said camera means becomes 
more independent from the central controller and capable of conducting 
much of the analyses and response function directly, 

35. (Delete) A system as defined in claim 1, said central controller with 
analysis fuzzy logic and methods as defined in claims 12, 13, 14, 15, 16, 
17, 18, 19, and 20, with these intelligent said analyses means can 
interpret those data stored in the said databases of the speech and facial 
observations made by said camera means and communicated by said 
local controller, to the said central controller for identification by said 
central controller of person or persons and/ or activities for potential threat 
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and by using said analysis comparisons to related databases of audio, 
visual and speech and text information to which the said central controller 
is connected via the Internet WEB, or by hardwired land, or telephonic, or 
wireless links the said Camera System means can learn of information of 
known terrorist person or persons and/ or known threats and can decide to 
continue searching in the data transmitted to the central controller by the 
local controller, said data from observations by the camera means, to 
detect such person, or persons or threats by matching the observations to 
the learned information and if so detected, can so inform security 
personnel and systems. 

36. (Delete) A system as defined in claim 1, located at the entrance or gate to 
a facility, such as an airport or flight departure area or the like, said system 
with a card reader/ writer, as defined in claim 2, for the purpose of reading 
from said facility entrance identity card and/or flight passenger ticket, 
having a magnetic recording strip, as defined in claim 7, or other recording 
means, as defined in claim 8 and claim 9, the said information stored on 
said magnetic recording strip or recording means and observing from said 
sensors as defined in claim 3, information as defined in claim 4, for 
storage by the local controller and communications of said information to 
said central controller for recording and storage of said information, said 
central controller can conduct analyses for determination whether to allow 
or deny entrance by the holder of said ticket or identity card after which 
said determination is communicated by the central controller to the said 
local controller for display on output devices as defined in claim 6. 

37. (Delete) A system as defined in claim 1 . located at the entrance or gate to 
a facility such as an apartment building, said system with a card reader/ 
writer, as defined in claim 2, for the purpose of reading from said facility 
entrance/ identity card, having a magnetic recording strip, as defined in 
claim 7, or other recording means, as defined in claim 8 and claim 9, the 



PAGE 8/50 * RCVD AT 4/6/2010 1 :22:19 PM [Eastern Daylight Time] * SVR:USPTO-EFXRF-6/25 * DNIS:2737320 * CSID:905 763 3884 * DURATION (mm-ss):14-34 



04/06/10 THE 12:34 FAX 905 763 3884 PhD Assoclat eslnc ©009 



said information stored on said magnetic recording strip or recording 
means and observing from said sensors as defined in claim 3, information 
as defined in claim 4, for storage by the local controller and 
communications of said information to said central controller for recording 
and storage of said information, said central controller can conduct 
analyses for determination whether to allow or deny entrance by the 
holder of said identity card after which said determination is 
communicated by the central controller to the said local controller for 
display on output devices as defined in claim 6. 

38. (Delete) A system as defined in claim 1 , located at the entrance or gate to 
a facility, such as a commercial building, said system with a card reader/ 
writer, as defined in claim 2, for the purpose of reading from said facility 
entrance/ identity card, having a magnetic recording strip, as defined in 
claim 7, or other recording means, as defined in claim 8 and claim 9, the 
said information stored on said magnetic recording strip or recording 
means and observing from said sensors as defined in claim 3, information 
as defined in claim 4, for storage by the local controller and 
communications of said information to said central controller for recording 
and storage of said information, said central controller can conduct 
analyses for determination whether to allow or deny entrance by the 
holder of said identity card after which said determination is 
communicated by the central controller to the said local controller for 
display on output devices as defined in claim 6. 

39. (Delete) A system as defined in claim 1, located at the entrance or gate to 
a facility, such as a gated community, said system with a card reader/ 
writer, as defined in claim 2, for the purpose of reading from said facility 
entrance/ identity card, having a magnetic recording strip, as defined in 
claim 7, or other recording means, as defined in claim 8 and claim 9, the 
said information stored on said magnetic recording strip or recording 
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means and observing from said sensors as defined in claim 3, information 
as defined in claim 4, for storage by the local controller and 
communications of said information to said central controller for recording 
and storage of said information, said central controller can conduct 
analyses for determination whether to allow or deny entrance by the 
holder of said identity card after which said determination is 
communicated by the central controller to the said local controller for 
display on output devices as defined in claim 6. 

40. (Delete) A system as defined in claim 1 , located at the entrance or gate to 
a facility, such as a condominium, said system with a card reader/ writer, 
as defined in claim 2, for the purpose of reading from said facility 
entrance/ identity card, having a magnetic recording strip, as defined in 
claim 7, or other recording means, as defined in claim 8 and claim 9, the 
said information stored on said magnetic recording strip or recording 
means and observing from said sensors as defined in claim 3, information 
as defined in claim 4, for storage by the local controller and 
communications of said information to said central controller for recording 
and storage of said information, said central controller can conduct 
analyses for determination whether to allow or deny entrance by the 
holder of said identity card after which said determination is 
communicated by the central controller to the said local controller for 
display on output devices as defined in claim 6. 

41 . (Delete) A system as defined in claim 1, located at the entrance or gate to 
a high security facility, such as a detention or jail, said system with a card 
reader/ writer, as defined in claim 2, for the purpose of reading from said 
facility entrance/ identity card, having a magnetic recording strip, as 
defined in claim 7. or other recording means, as defined in claim 8 and 
claim 9, the said information stored on said magnetic recording strip or 
recording means and observing from said sensors as defined in claim 3, 
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information as defined in claim 4, for storage by the local controller and 
communications of said information to said central controller for recording 
and storage of said information, said central controller can conduct 
analyses for determination whether to allow or deny entrance by the 
holder of said identity card after which said determination is 
communicated by the central controller to the said local controller for 
display on output devices as defined in claim 6. 

42. (Delete) A system as defined in claim 1 , located at the entrance or gate to 
a secret operations facility, such as a research center or laboratory or 
document depository, said system with a card reader/ writer, as defined in 
claim 2, for the purpose of reading from said facility entrance/ identity 
card, having a magnetic recording strip, as defined in claim 7, or other 
recording means, as defined in claim 8 and claim 9, the said information 
stored on said magnetic recording strip or recording means and observing 
from said sensors as defined in claim 3, information as defined in claim 4, 
for storage by the local controller and communications of said information 
to said central controller for recording and storage of said information, said 
central controller can conduct analyses for determination whether to allow 
or deny entrance by the holder of said identity card after which said 
determination is communicated by the central controller to the said local 
controller for display on output devices as defined in claim 6. 

43. (Delete) A system as defined in claim 1, located at the entrance or gate to 
a country or place, such as a border crossing or the like, said system with 
a card reader/ writer, as defined in claim 2, for the purpose of reading from 
sard facility entrance/ identity card or passport, having a magnetic 
recording strip, as defined in claim 7, or other recording means, as defined 
in claim 8 and claim 9, the said information stored on said magnetic 
recording strip or recording means and observing from said sensors as 
defined in claim 3, information as defined in claim 4, for storage by the 
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local controller and communications of said information to said central 
controller for recording and storage of said information, said central 
controller can conduct analyses for determination whether to allow or deny 
entrance by the holder of said identity card after which said determination 
is communicated by the central controller to the said local controller for 
display on output devices as defined in claim 6. 

44. A system as defined in claim 1, located at the a vehicle parking facility for 
the purpose of observation of activities such as the drinking parties at 
athletic events, often called Tail-Gate" parties, occurring in that parking 
facility to monitor the alcoholic drinking before and/ or after performances 
at arenas and the like, for the detection of alcohol abuse and its potential 
threat to the public, and/ or to fans at the arenas and/or to the arena it self. 

45. A security camera means observational system comprising: 

a) a local controller, hardware, software, firmware and fuzzy logic 
including wireless or wired communications interface for 
communicating with a central controller facility; 

b) a camera audio and video recording device connected to said local 
controller for observing and recording and communicating to said 
central controller; 

c) a central controller with hardware, software, firmware and fuzzy 
logic for database storage and analyses of images and sounds 
from observed actions, appearances, activities, speech and 
movements of objects, animals, persons and surroundings within 
view and listening of the said camera device as communicated from 
said camera devices; 

d) a central controller with hardware, software, firmware and fuzzy 
logic for accessing both real-time data and historic data from 
related databases from sources of governments, of multimedia 
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news agencies, of associated data for the purpose of conducting 
analyses for assessment and detection of threat or potential threat; 

e) an input device connected to said local controller for reading from 
or writing to magnetic or electronic storage data means and/ or a 
manually entering data means for input to said local controller; 

f) an output device associated with said local controller for displaying 
visually or audibly or in printed means for presenting a selection of 
information and threat analysis results received from said central 
facility controller; 

g) a camera movement device and interface to the local controller for 
three axis pointing, focusing/ zooming and turn on/ off control of the 
said camera device. 

46. A system as defined in claim 45, said input device including a "closed 
circuit" security camera and microphones, with magnetic tape recording 
and computer database data storage means, and a plurality of sensors, 
coupled to the local controller for providing information on a plurality of 
parameters related to the local area observed. 

47. A system as defined in claim 46, said local controller including an input 
keyboard, key pad, touch screen manual device, a magnetic card or smart 
card reader/ writer, a display, a voice I/O interface, and interface means. 

48. A system as defined in claim 46, said local controller including an output 
device being a computer video screen and speaker and indicator lights 
and printing means, magnetic or smart card recorder means, for providing 
or indicating information regarding validity or acceptance of a request for 
entrance or access or purchase based on analyses by said central 
controller. 



PAGE 13/50 * RCVD AT 4/612010 1:22:19 PM [Eastern Daylight Time] 1 SVfcUSPTO£FXRF-6/25 * DNIS:2737320 ' CSID:905 763 3884 • DURATION (mm-ss):14-34 



04/06/10 TUE 12:36 FAX 905 763 3884 



PhD Associates Inc 



@014 



49. A system as defined in claim 47, said magnetic card being a ticket 
including a magnetic strip on which can be recorded the place, event, date 
and access permitted the holder of said ticket. 

50. A system as defined in claim 48, said printing means including printing on 
paper and/or printing on a ticket for access or attendance to a place and/ 
or event. 

51. A system as defined in claim 50, said printing on said ticket including 
indication of no access or no attendance or no purchase using printing of 
wording such as H VOID". 

52. A system as defined in claim 45, said central controller monitoring and 
storing in databases the information communicated by the local controller, 
the data from the local camera and sensor means and analyzing this 
information and comparative information from related databases. 

53. A system as defined in claim 45, said central controller analyses includes 
a plurality of analyses logic including the use of fuzzy logic and 
comparisons accessing related databases of stored previous visual data 
such as faces of persons, and/ or audio data such as speech, voice to text 
conversion, and/ or text data such as key words or phrases from which the 
system using fuzzy logic matches those aspects of the current 
observations for the purpose of assessing the level of sobriety due to drug 
or alcohol use and the existence of a resulting threat or potential threat. 

54. A system as defined in claim 53, said central controller analyses 
accessing said related databases including sources of government 
systems, of multi-media news systems and of associated systems. 
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55. A system as defined in claim 45, said central controller analyses includes 
a plurality of analyses methods including voice stress, emotion stress, 
actions and movement interpretation, image matching, speech/ voice to 
text conversions, lip reading to text conversion, deep extraction of 
information from text, facial identity matching, voice identity matching and 
personal data matching and comparisons accessing stored related 
database sources of stored previously of visual data such as faces of 
persons, and/ or audio data such as speech, and/ or text data such as key 
words or phrases from which the system using fuzzy logic matches those 
aspects of the current observations for the purpose of identifying people, 
animals, things, actions, speech, and stress that indicate the level of 
sobriety due to drug or alcohol use and the existence of a resulting threat 
or potential of a threat. 

56. A system as defined in claim 55, said central controller analyses 
accessing said stored related databases including sources of government 
systems, of multi-media news systems and of associated systems. 

57. A system as defined in claim 45, located at roadside policing and 
inspection arrangements such as the "RIDE, reduce impaired driving 
everywhere" programs for the detection of vehicle driver alcoholic 
intoxication or drug abuse for the purpose of detecting potential threat to 
the public, to property and to the driver himself. 

58. A system as defined in claim 57, for which the reading means defined in 
claim 5, reads a said magnetic card or smart card, said card being a 
driver's license. 

59. A system as defined in claim 47, said magnetic card or smart card being a 
driver's license. 
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60. A system as defined in claim 45, for the detection and analyzes of alcohol 
or drug intoxication or impairment of a person or persons for the detection 
of person or persons as a potential threat to the public and/or to property 
and/or to themselves. 

61. A system as defined in claim 45, said central controller with analysis fuzzy 
logic and methods, with these intelligent said analyses means can 
interpret those data stored in the said databases of the speech and facial 
observations made by said camera means and communicated by said 
local controller, to the said central controller for identification by said 
central controller of person or persons and/ or activities for potential threat 
as indicated in claim 60 and by using said analysis comparisons to related 
databases of audio, visual and speech and text information to which the 
said central controller is connected via the Internet WEB, or by hardwired 
land, or telephonic, or wireless links the said Camera System means can 
learn of information of known levels of said alcohol or drug intoxication or 
impairment such that the said Camera System means can determine and 
establish visual response measures as standard sets of levels of such 
intoxication or impairment. 

62. A system as defined in claim 60, said analyzes determining a level of 
intoxication or impairment so as to assign a numerical value to said level, 
as an indication within a standard set of said levels as to the said 
intoxication or impairment of the person or persons similar to the 
application of breathalyzer standards used to describe the level of alcohol 
intoxication as determined by chemical measure of the breath of a person. 

63. A system as defined in claim 60, for which the said central controller with 
analysis fuzzy logic and methods, with these intelligent said analyses 
means can interpret those data stored in the said databases of the speech 
and facial observations by said camera means communicated by said 
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local controller, to the said central controller for identification by said 
central controller of person or persons and/ or activities for potential threat 
and by using said analysis comparisons to related databases of audio, 
visual and speech and text information to which the said central controller 
is connected via the Internet WEB, or by hardwired land, or telephonic, or 
wireless links the said Camera System means can learn to compile a 
profile describing the level of drug or alcohol intoxication of the observed 
person or persons and can thus assess and assign a numerical 
description of that level from analyses of the said data from observations 
by the camera means of the said person or persons and can communicate 
the said determined level to the local controller for display so as to inform 
appropriate personnel and systems. 

64. A system as defined in claim 45, located at the entrance or admissions to 
a hospital or health facility such as a clinic or the like. 

65. A system as defined in claim 64 for the detection of health related 
problems such as heart attack, diabetic or epileptic seizure, drug use or 
abuse, drunkenness and the like. 

66. (Delete) A system as defined in claim 45, located at the entrance or gate 
to a hospital or health facility, such as a clinic or the like, said system with 
a card reader/ writer, as defined in claim 46, for the purpose of reading 
from said facility entrance/ identity card or health insurance card, having a 
magnetic recording strip, as defined in claim 49, or other recording means, 
the said information stored on said magnetic recording strip or recording 
means and observing from said sensors, information for storage by the 
local controller and communications of said information to said central 
controller for recording and storage of said information and for said central 
controller to conduct analyses for determination whether to allow or deny 
entrance by the holder of said identity card after which said determination 
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is communicated by the central controller to the said local controller for 
display on output devices as defined in claim 48. 

67. A system as defined in claim 47, said magnetic card or smart card being a 
health or insurance card. 

68. A system as defined in claim 54, said multi-media news systems include 
printed media such as newspapers, reports, magazines; also include 
electronic versions of printed media; also include WEB internet source 
media; also include radio and television broadcasts, for both real-time 
"live" access and stored/ retrieved database linkages. 

69. A system as defined in claim 45, located at a beer parlor or bar for policing 
and inspection arrangements such as the "RIDE, reduce impaired driving 
everywhere" programs for the detection of potential vehicle driver alcoholic 
intoxication or drug abuse for the purpose of detecting the level of said 
intoxication or impairment due to alcohol or drug abuse and the potential 
threat to the public, to property and to the driver himself. 

70. A system as defined in claim 69, located at a nightclub. 

71. A system as defined in claim 69, located at a restaurant licensed to sell 
alcohol. 

72. A system as defined in claim 69, located at a rental hall licensed to sell 
alcohol. 

73. A system as defined in claim 46, one of said sensors being a GPS, geo- 
positioning system, location sensor with interface to the local controller for 
mobile applications for the determination of location and retrieval of such 
parameters from the GPS. 
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74. (Delete) A system as defined in claim 45, located at the entrance or gate 
to a country or place, such as a border crossing or the like, said system 
with a card reader/ writer, as defined in claim 46, for the purpose of 
reading from said facility entrance/ identity card or passport, having a 
magnetic recording strip, as defined in claim 49, or other recording means, 
the said information stored on said magnetic recording strip or recording 
means and observing from said plurality of said camera means and 
sensors, information, for storage by the local controller and 
communications of said information to said central controller for recording 
and storage of said information, said plurality of camera means being 
arranged so as to observe the occupants in several vehicles including the 
vehicle closest to the said gate or entrance. 

75. (Delete) A system as defined in claim 45, located at a line of vehicles, 
such as at roadside policing. and inspection arrangements such as the 
"RIDE, reduce impaired driving everywhere" programs for the detection of 
vehicle driver alcoholic intoxication or drug abuse or the like, said system 
with a card reader/ writer, as defined in claim 46, for the purpose of 
reading a drivers license, having a magnetic recording strip, as defined in 
claim 49, or other recording means, the said information stored on said 
magnetic recording strip or recording means and observing from said 
plurality of said camera means and sensors, information, for storage by 
the local controller and communications of said information to said central 
controller for recording and storage of said information, said plurality of 
camera means being arranged so as to observe the occupants in several 
vehicles including the vehicle closest to the said policing and inspection 
arrangements. 

76. A system as defined in claim 69, located in a vehicle. 



PAGE 19/50 • RCVD AT 4/6/2010 1:22:19 PM [Eastern Daylight Time] ' SVR:USPTO-EFXRF-6/25 1 DNIS:2737320 1 CSID:905 763 3884 ■ DURATION (mm-ss):14-34 



04/06/10 TUE 12:37 FAX 905 763 3884 



PhD Associates Inc 



0020 



77. A system as defined in claim 76, said system including sensors, fuzzy 
logic analyses and interfaces to the vehicle systems to monitor and control 
vehicle components such as ignition, fuel, starter and the like and 
analyses to detect attempts to interfere or tamper with said systems 
including the camera means system. 

78. A system as defined in claim 76, said system including fuzzy logic capable 
of viewing and storing facial images in the database memory of local 
controller. 

79. (Delete) A systems as defined in claim 76, including fuzzy logic capable 
of facial analyses to determine if current viewed facial image matches one 
of the stored facial images as defined in claim 77 and if not so matched 
said fuzzy logic capable of disabling one or more of said vehicle 
components. 

80. A system as defined in claim 78, said non matching facial analysis 
condition if or when determined, the condition and the vehicle's GPS 
location is reported report by wireless communications to the central 
controller for notification to the proper authorities and the said system can 
disable said vehicle, 

81. (Delete) A system as defined in claim 76 3 including fuzzy logic capable of 
analyses determining the impairment as defined in claim 60 and the level 
of said impairment as defined in claim 62, of the person attempting to start 
or drive said vehicle and if or when said impairment is determined, the 
said level of impairment and the vehicle's GPS location is reported report 
by wireless communications to the central controller for notification to the 
proper authorities and the said system can disable said vehicle and said 
system can continue said analyses and said reporting. 
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82. A system as defined in claim 77, said system analyses having detected 
said attempts to interfere or tamper with said systems including the 
camera means system, if or when such interference or tampering is 
determined the said tampering and the vehicle's GPS location is reported 
report by wireless communications to the central controller for notification 
to the proper authorities and the said system can disable said vehicle. 
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83. (NEW) A system as defined in claim 1, said input device including a 
camera and/ or a "closed circuit" security camera which said camera can 
observe and record said observation in a spectral range including but not 
limited to the visible, the near infrared, the infrared, the far thermal or 
heat range infrared, and the ultraviolet regions of the electromagnetic 
spectrum, and microphones, with magnetic tape recording and computer 
database data storage means, and a plurality of sensors, coupled to the 
local controller for providing information on a plurality of parameters 
related to the local area observed. 

84. (Delete) A system as defined in claims 2. 3, and 83, said camera and 
said sensors including a plurality of motion, heat which could include 
static and/ or video observation and recording systems, sound, vibration 
and air quality sensors for detection of people, animals, things or actions 
that are not of the regular normal occurrence or could pose a threat. 

85. (Delete) A system as defined in claims 1,13, and 83 said central 
controller analyses includes a plurality of analyses logic including the 
use of fuzzy logic and comparisons accessing related databases of 
stored previous video observations in one or more spectral ranges of 
any such as faces of persons, and/ or audio data such as speech, voice 
to text conversion, and/ or text data such as key words or phrases from 
which the system using fuzzy logic matches those aspects of the current 
observations for the purpose of assessing the existence of a threat or 
potential threat. 

86. (Delete) A system as defined in claims 1,13. and 83 said central 
controller analyses includes a plurality of analyses logic including the 
use of fuzzy logic and comparisons accessing related databases of 
stored previous video observations in one or more spectral ranges and 
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specifically of the visible and of the thermal far infrared ranges of any 
such as faces of persons and/ or the environment in which those 
persons are observed, and/ or audio data such as speech, voice to text 
conversion, and/ or text data such as key words or phrases from which 
the system using fuzzy logic matches those aspects of the current 
observations for the purpose of assessing the existence of a threat or 
potential threat 

87. (Delete) A system as defined in claims 1, 15 and 83 said central 
controller analyses includes a plurality of analyses logic including the 
use of fuzzy logic and comparisons accessing "live" real-time related 
database sources of video observations in one or more spectral ranges 
of any data such as faces of persons, and/ or audio data such as 
speech, voice to text conversion, and/ or text data such as key words or 
phrases from which the system using fuzzy logic matches those aspects 
of the current observations for the purpose of assessing the existence of 
a threat or potential threat. 

88. (Delete) A system as defined in claims 1. 15 and 83 said central 
controller analyses includes a plurality of analyses logic including the 
use of fuzzy logic and comparisons accessing "live" real-time related 
database sources of video observations in one or more spectral ranges 
and specifically of the visible and of the thermal far infrared ranges of 
any data such as faces of persons, and/ or audio data such as speech, 
voice to text conversion, and/ or text data such as key words or phrases 
from which the system using fuzzy logic matches those aspects of the 
current observations for the purpose of assessing the existence of a 
threat or potential threat. 

89. (Delete) A system as defined in claims 1 , 21 and 83 said security 

camera means system can include a plurality of such systems with video 
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observations in one or more spectra, ranges each of which can be 
observing the same or different said images and sounds from observed 
act.ons, appearances, activities, speech-and movements of objects 
an.mals, persons and surroundings and from the same or different ' 
locat.ons. all of which can communicate with the said centra, facility 
controller. 

90. (Delete) A system as defined in Cairns 2, 30 and 83 said input device 
including a "Cosed circuit" security camera which said camera can 
observe and record said observation in a spectral range including but not 
limited to the visible, the near infrared, the -nfrared, the far therma. or " 
heat range infrared, and the ultraviolet regions of the electromagnetic 
spectrum and microphones such that the microphones are arranged so 
that one detects sounds originating in from front of the camera and the 
other detects sounds originating from behind the camera. 

91. (Delete) A system as defined in claims 1, 4, and 83 said input device 
can observe and record said observation in a spectral range including 
but not limited to the visible, the near infrared, the infrared, the far 
thermal or heat range infrared, and the ultraviolet regions of the 
electromagnetic speCrum, and microphones, with magnetic tape 
recording and computer database data storage means, and a plurality of 
sensors, coupled to the local controller for providing information on a 
plurality of parameters related to the local area observed said 
parameters including but not limited to observing an individual person 
animal, thing or action, groups of said people, animals things or actions 
the recording of which parameters the system using fuzzy logic matches 
those aspects of the current observations for the purpose of assessing 
the ex.stence of a threat or potential threat. 
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92. (Delete) A system as defined in claims 1, 4, and 83 said input device 
can observe and record said observation in a spectral range including 
but not limited to the visible, the near infrared, the infrared, the far 
thermal or heat range infrared, and the ultraviolet regions of the 
electromagnetic spectrum, and with/ or without microphones, with 
magnetic tape recording and computer database data storage means, 
and a plurality of sensors, coupled to the local controller for providing 
information on a plurality of parameters related to the local area 
observed said parameters including but not limited to observing groups 
of said people, specifically; audiences, crowds and/ or audience and/ or 
crowd actions, and observing individuals that are connected to and/ or 
part of said group or crowd or audience, the recording of which 
parameters the system using fuzzy logic matches those aspects of the 
current observations for the purpose of assessing the existence of a 
threat or potential threat and/ or riot and/ or public disturbance or violent 
behavior. 

93. (NEW) A system as defined in claim 83 said input device can observe 
and record said observation in one or more spectral range, and with/ or 
without microphones, with magnetic tape recording and computer 
database data storage means, and a plurality of sensors, coupled to the 
local controller for providing information on a plurality of parameters 
related to the local area observed said parameters specifically one of 
which is the observation of the appearance and/ or actions, of a person 
with which parameters the system using fuzzy logic matches those 
aspects of the current observations for the purpose of assessing the 
existence, inference and/ or the measurement of levels of alcohol 
consumption, state of intoxication and/ or threat or potential threat and/ 
or public disturbance or violent behavior of said person. 
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k (Delete) A system as defined in claims 3, 83, and 93 said input device 
can observe and record said observation in one or more spectral range, 
and with/ or without microphones, with magnetic tape recording and 
computer database data storage means, and a plurality of sensors, 
coupled to the local controller for providing information on a plurality of 
parameters related to the local area observed said parameters 
specifically one of which is the observation of the appearance and/ or 
actions, of a person from which parameters the system using fuzzy logic 
matches those aspects of the current observations including but not 
limited to the comparison of observations in the visible and thermal 
infrared heat range for the purpose of assessing the existence, inference 
and/ or the measurement of an aura and/ or image representations of 
that person relating to said person's level of alcohol consumption, state 
of intoxication and/ or threat or potential threat and/ or public disturbance 
or violent behavior. 



95. (Delete) A system as defined in claims 83, and 93 said input device can 
observe and record said observations in one or more spectral range, and 
with/ or without microphones, with magnetic tape recording and 
computer database data storage means, and a plurality of sensors, 
coupled to the local controller for providing information on a plurality of 
parameters related to the local area observed said parameters one of 
which specifically is the observation of the appearance and/ or actions, 
of groups and/ or crowds of persons from which parameters the system 
using fuzzy logic matches those aspects of the current observations 
including but not limited to the comparison of observations in the visible 
and thermal infrared, for the purpose of assessing the existence, 
inference and/ or the measurement of an aura and/ or image 
representations of said persons and/ or crowds relating to the threat or 
potential threat and/ or public disturbance and/ or violent behavior and/ 
or riot or potential for riot from which said assessment, the system using 
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fuzzy logic matching those aspects of the current observations, predicts 
the level of said threat, disturbance, violent behavior or riot. 

96. (Delete) A system as defined in claims 1, 2, 3, and 83 said camera and 
said sensors include pressure sensitive vibration and motion sensors for 
the detection of the occurrence and motion of the feet of people, animals 
or things. 

97. (Delete) A system as defined in claims 1, 2,3, and 83, said sensors 
including pressure sensitive mats, pads and switches for the detection of 
said occurrences and motion of the feet of said people, animals or 
things. 

98. (Delete) A system as defined in claims 1, 13,83, and 93 said central 
controller analysis includes a plurality of analyses logic including the use 
of fuzzy logic and comparisons accessing related databases of stored 
previous observations of the patterns, rhythm, cadence, frequency, and 
characteristics to determine and identify such foot motions and 
relationships to detect the condition, including but not limited to the 
physical, emotional, staggering, and intoxication levels of the particular 
person, animal ore thing who's said foot motion is being detected. 

99. (Delete) A system as defined in claims 83 and 93 in which said 
observations and recordings of said faces, voices, actions, said sensors 
include pressure sensitive vibration and motion sensors for the detection 
of the occurrence and motion of the feet of people, animals or things, are 
specifically applied to the environment of drinking establishments, bars, 
nightclubs, dance clubs and entertainment venues in which said 
observations and recordings are retained and/ or exchanged with other 
establishments for the purpose of identifying said people, individuals, 
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audiences, crowds and/ or their actions that could be a threat or potential 
threat and/ or riot and of public disturbance at said establishments. 

100, (Delete) A system as defined in claims 1, 83 and 93 in which said 
observations and recordings of said faces, voices, actions, include 
pressure sensitive vibration and motion sensors for the detection of the 
occurrence and motion of the feet of people, animals or things and fuzzy 
logic analyses as apply to drinking establishments, bars, nightclubs, 
dance clubs, entertainment venues and sports venues in which said 
observations and recordings are retained and/ or exchanged with an 
established group or "POD" of similar such establishments where by 
patrons of one such "POD" establishment can be identified by other 
members of said POD, thereby allowing said members of the POD to be 
alerted to the identity of said persons, animals or things representing 
said threat of potential threat for which said members could take 
appropriate action against such persons, animals or things and/or the 
said threat or potential threat. 

101 . (NEW) A system as defined by a central controller can communicate to 
any of said plurality of said security camera means systems' local 
controllers, as defined in claim 21, of said camera means, said 
commands for said pointing focusing/ zooming viewing direction, viewing 
zoom magnification and turn on/ off of camera and/ or controls. 

102 (NEW) A system as defined by a central controller can communicate to 
any of said plurality of said security camera means systems' local 
controllers, as defined in claim 21 , for the said purpose of receiving 
observational data for storage, and some of or all of said analyses as 
defined in claims 14, 16, 18, and 20. 
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103 (NEW) A system as defined by a central controller can communicate to 
any of said plurality of said security camera means systems' local 
controllers, as defined in claim 21, for the said purpose of receiving 
observational data for storage, and some of or all of said analyses as 
defined in claims 14, 16, 18, and 20, with the results of said analyses 
said central controller can learn what is occurring in said observations by 
comparing observations from a plurality of the said security camera 
means such that the central controller can make decisions for said 
commands to be communicated to selected security camera means, as 
defined in claim 22, for the purpose of conducting more detailed 
observations thereby permitting the central controller to further conduct 
more detailed analyses. 

104 (NEW) A system as defined by a central controller, if from its said 
analyses as defined in claims 14, 16, 18, and 20, it has concluded that 
said actions or posed threat exists, the said central controller can 
communicate the actions or threat so concluded to the appropriate 
security personnel and facilities for which the system has been 
established. 

105 (NEW) A system as located at the entrance or gate to a facility, such as 
a sports arena, said system with a card reader/ writer, for the purpose of 
reading from said facility, an entrance/ performance attendance ticket, 
having a magnetic recording strip, as defined in claim 7, or other 
recording means, as defined in claim 8 and claim 9, having read the said 
information stored on said magnetic recording strip or recording means 
and observing from said sensor and information as defined in claim 4, for 
storage by the local controller, can carryout communications of said 
information to said central controller for recording and storage of said 
information and for said central controller to conduct analyses for 
determination whether to allow or deny entrance by the holder of said 
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ticket after which, the said determination is communicated by the central 
controller to the said local controller for display on output devices as 
defined in claim 6. 

106 (NEW) A system, located at the entrance or gate to a facility, such as a 
sports arena, said system with a card reader/ writer, for the purpose of 
reading from said ticket having a magnetic recording strip as defined in 
claim 7, or other recording means, as defined in claim 8 and claim 9, or 
printing means as defined in claim 11, having read the said information 
stored on said magnetic recording strip or recording means for storage 
by the local controller and communications of said information to said 
central controller for recording and storage of said information and said 
central controller conducts analyses for determination of allowed alcohol 
limit after which said determination is communicated by the central 
controller to the said local controller for display on output devices as 
defined in claim 6 and includes writing to the said magnetic recording 
strip or recording means or printing on said ticket with said printing 
means, the alcohol limit with the initial purchased alcohol amount 
indicating zero purchased. 

107 (NEW) A system, located at a concession or sales facility, such as a 
beer selling counter, said system with a card reader for the purpose of 
reading from said ticket having a magnetic recording strip as defined in 
claim 7, the said information stored on said magnetic recording strip for 
storage by the local controller and said system with an input device for 
entry of and/ or request by said holder of said ticket for the purchase of a 
specific amount of alcohol, such as beer, and the communications of 
said information to said central controller for recording and storage of 
said information can carryout analyses for determining total amount of 
alcohol purchased including current request and all previous requests 
recorded to that ticket and using fuzzy logic comparing said total to limit 
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amount recorded on said ticket can determine to allow or deny, 
according to being under or over said limit, the said purchases by the 
holder of said ticket after which said determination is communicated by 
the central controller to the local controller for display on output devices 
as defined in claim 6 including, if purchase is denied, printing "VOID" on 
the said ticket and/ or recording "NO SALE" on the said magnetic strip of 
said ticket and/ or displaying "NO SALE" on said output computer video 
display screen, and/ or in voice over said speaker saying "NO SALE", 
and said central controller also communicated to local controller of a 
camera means, which is located such that it is capable of observing the 
seat location indicated on said ticket. 

108 (NEW) A system with said microphones as defined in claim 30 
interfaced to a local controller, with said local controller having fuzzy 
logic capable of detecting sound from said microphones said local 
controller can determine the direction of said sound and with such 
determination the local controller being able to command the said 
camera means controls for pointing, focusing/ zooming, viewing 
direction, viewing zoom magnification and turning on/ off camera said 
local controller can command the said camera means to observe what is 
in the direction from which the sound originated and to report those 
observations to the said central controller. 

109 (NEW) A system with said microphones as defined in claim 30 
interfaced to a local controller, with said local controller having fuzzy 
logic capable of detecting sound from said microphones can 
communicate that sound to the central controller for analyses 
determining the speech, text, and meaning of key phrases and words, 
such as "bomb" and if such analyses detects a threatening phrase or 
word, the central controller fuzzy logic can decide to instruct the local 
controller to command the said camera means controls for pointing, 
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focusing/ zooming, viewing direction, viewing zoom magnification and 
turning on/ off camera with which said commands the said camera 
means can observe what action or actions is or are occurring in the 
direction from which the text originated and to report those observations 
to the said central controller. 

110 (NEW) A system with central controller with analysis fuzzy logic and 
methods as defined in claims 12, 14, 16, 18, and 20, with these 
intelligent said analyses means can interpret those data stored in the 
said databases of the speech and facial observations made by said 
camera means and communicated by said local controller, to the said 
central controller for identification by said central controller of person or 
persons and/ or activities for potential threat and by using said analysis 
comparisons to related databases of audio, visual and speech and text 
information to which the said central controller is connected via the 
Internet WEB, or by hardwired land, or telephonic, or wireless links the 
said Camera System means can learn of information of known terrorist 
person or persons and/ or known threats and can decide to continue 
searching in the data transmitted to the central controller by the local 
controller, said data from observations by the camera means, to detect 
such person, or persons or threats by matching the observations to the 
learned information and if so detected, can so inform security personnel 
and systems. 

1 1 1 (NEW) A system, located at the entrance or gate to a facility, such as ■ 
an airport or flight departure area or the like, said system with a card 
reader/ writer, for the purpose of reading from said facility entrance 
identity card and/or flight passenger ticket, having a magnetic recording 
strip, as defined in claim 7, or other recording means, as defined in claim 
8 and claim 9, the said information stored on said magnetic recording 
strip or recording means and observing from sensors for information as 
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defined in claim 4, for storage by the local controller and 
communications of said information to said central controller for 
recording and storage of said information, said central controller can 
conduct analyses for determination whether to allow or deny entrance by 
the holder of said ticket or identity card after which said determination is 
communicated by the central controller to the said local controller for 
display on output devices as defined in claim 6. 

1 12 (NEW) A system, located at the entrance or gate to a facility such as an 
apartment building, said system with a card reader/ writer, for the 
purpose of reading from said facility entrance/ identity card, having a 
magnetic recording strip, as defined in claim 7, or other recording 
means, as defined in claim 8 and claim 9, the said information stored on 
said magnetic recording strip or recording means and observing from 
sensors for information as defined in claim 4, for storage by the local 
controller and communications of said information to said central 
controller for recording and storage of said information, said central 
controller can conduct analyses for determination whether to allow or 
deny entrance by the holder of said identity card after which said 
determination is communicated by the central controller to the said local 
controller for display on output devices as defined in claim 6. 

113 (NEW) A system, located at the entrance or gate to a facility, such as a 
commercial building, said system with a card reader/ writer, for the 
purpose of reading from said facility entrance/ identity card, having a 
magnetic recording strip, as defined in claim 7, or other recording 
means, as defined in claim 8 and claim 9, the said information stored on 
said magnetic recording strip or recording means and observing from 
sensors for information as defined in claim 4, for storage by the local 
controller and communications of said information to said central 
controller for recording and storage of said information, said central 



PAGE 33I50 * RCVD AT 4/6/2010 1:22:19 PIYI [Eastern Daylight Time] " SVR:USPT0£FXRF-6I25 1 DNIS:2737320 * CSID:905 763 3884* DURATION (mm-ss):14-34 



04/06/10 TUE 12:41 FAX 905 763 3884 



PhD As sociates Inc 



121034 



controller can conduct analyses for determination whether to allow or 
deny entrance by the holder of said identity card after which said 
determination is communicated by the central controller to the said local 
controller for display on output devices as defined in claim 6. 

1 14 (NEW) A system, located at the entrance or gate to a facility, such as a 
gated community, said system with a card reader/ writer, for the purpose 
of reading from said facility entrance/ identity card, having a magnetic 
recording strip, as defined in claim 7, or other recording means, as 
defined in claim 8 and claim 9, the said information stored on said 
magnetic recording strip or recording means and observing from sensors 
for information as defined in claim 4, for storage by the local controller 
and communications of said information to said central controller for 
recording and storage of said information, said central controller can 
conduct analyses for determination whether to allow or deny entrance by 
the holder of said identity card after which said determination is 
communicated by the central controller to the said local controller for 
display on output devices as defined in claim 6. 

115 (NEW) A system, located at the entrance or gate to a facility, such as a 
condominium, said system with a card reader/ writer, for the purpose of 
reading from said facility entrance/ identity card, having a magnetic 
recording strip, as defined in claim 7, or other recording means, as 
defined in claim 8 and claim 9, the said information stored on said 
magnetic recording strip or recording means and observing from sensors 
for information as defined in claim 4, for storage by the local controller 
and communications of said information to said central controller for 
recording and storage of said information, said central controller can 
conduct analyses for determination whether to allow or deny entrance by 
the holder of said identity card after which said determination is 
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communicated by the central controller to the said local control for 
display on output devices as defined in claim 6. 

116 (NEW) A system, located at the entrance or gate to a high security 
achty. such as a detention or jail, said system with a card reader/ writer 
for the purpose of reading from said facility entrance/ identity card 
havrng a magnetic recording strip, as defined in claim 7, or other ' 
recording means, as defined in claim 8 and claim 9, the said information 
stored on said magnetic recording strip or recording means and 
observing from sensors for information as defined in claim 4, for storage 
by the local controller and communications of said information to said 
central controller for recording and storage of said information, said 
central controller can conduct analyses for determination whether to 
allow or deny entrance by the holder of said identity card after which said 
determination is communicated by the central controller to the said local 
controller for display on output devices as defined in claim 6. 

117 (NEW) A system, located at the entrance or gate to a secret operations 
facility, such as a research center or laboratory or document depository 
sa,d system with a card reader/ writer, for the purpose of reading from ' 
sa,d facility entrance/ identity card, having a magnetic recording strip as 
defined in claim 7, or other recording means, as defined in claim 8 and 
cla.m 9, the said information stored on said magnetic recording strip or 
recording means and observing from sensors for information as defined 
m claim 4, for storage by the local controller and communications of said 
information to said centra, controller for recording and storage of said 
information, said central controller can conduct analyses for 
determination whether to allow or deny entrance by the holder of said 
•dentrty card after which said determination is communicated by the 
central controller to the said local controller for display on output devices 
as defined in claim 6. 
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118 (NEW) A system, located at the entrance or gate to a country or place, 
such as a border crossing or the like, said system with a card reader/ 
writer, for the purpose of reading from said facility entrance/ identity card 
or passport, having a magnetic recording strip, as defined in claim 7, or 
other recording means, as defined in claim 8 and claim 9, the said 
information stored on said magnetic recording strip or recording means 
and observing from sensors for information as defined in claim 4, for 
storage by the local controller and communications of said information to 
said central controller for recording and storage of said information, said 
central controller can conduct analyses for determination whether to 
allow or deny entrance by the holder of said identity card after which said 
determination is communicated by the central controller to the said local 
controller for display on output devices as defined in claim 6. 

119 (NEW) A system, located at the entrance or gate to a hospital or health 
facility, such as a clinic or the like, said system with a card reader/ writer, 
for the purpose of reading from said facility entrance/ identity card or 
health insurance card, having a magnetic recording strip, as defined in 
claim 49, or other recording means, the said information stored on said 
magnetic recording strip or recording means and observing from said 
sensors, information for storage by the local controller and 
communications of said information to said central controller for 
recording and storage of said information and for said central controller 
to conduct analyses for determination whether to allow or deny entrance 
by the holder of said identity card after which said determination is 
communicated by the central controller to the said local controller for 
display on output devices as defined in claim 48. 

120 (NEW) A system, located at the entrance or gate to a country or place, 
such as a border crossing or the like, said system with a card reader/ 
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writer, for the purpose of reading from said facility entrance/ identity card 
or passport, having a magnetic recording strip, as defined in claim 49, or 
other recording means, the said information stored on said magnetic 
recording strip or recording means and observing from said plurality of 
said camera means and sensors, information, for storage by the local 
controller and communications of said information to said central 
controller for recording and storage of said information, said plurality of 
camera means being arranged so as to observe the occupants in 
several vehicles including the vehicle closest to the said gate or 
entrance. 

121 (NEW) A system, located at a line of vehicles, such as at roadside 
policing and inspection arrangements such as the "RIDE, reduce 
impaired driving everywhere" programs for the detection of vehicle driver 
alcoholic intoxication or drug abuse or the like, said system with a card 
reader/ writer, for the purpose of reading a drivers license, having a 
magnetic recording strip, as defined in claim 49, or other recording 
means, the said information stored on said magnetic recording strip or 
recording means and observing from said plurality of said camera means 
and sensors, information, for storage by the local controller and 
communications of said information to said central controller for 
recording and storage of said information, said plurality of camera 
means being arranged so as to observe the occupants in several 
vehicles including the vehicle closest to the said policing and inspection 
arrangements. 

122 (NEW) A systems, including fuzzy logic capable of facial analyses to 
determine if current viewed facial image matches one of the stored facial 
images as defined in claim 77 and if not so matched said fuzzy logic 
capable of disabling one or more of said vehicle components. 
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and rf or when said impairment is determined, the said level of 
impairment and the vehicle's GPS location is reported report by wireless 
communications to the oenfra, controller for notification to the proper 
authorities and the said system can disable said vehicle and said system 
can continue said analyses and said reporting. 

124 (NEW, A system with a camera and sensors including a plurality of 
motion, heat which could include static and/ or video observation and 
record.ng systems, sound, vibration and air quality sensors for detection 
of people, animals, things or actions that are not of the regular normal 
occurrence or could pose a threat. 

125 (NEW) A system as defined in claims 1 3, and 83 said central controller 
analyses includes a plurality of analyses logic including the use of toy 
logic and comparisons accessing related databases of stored previous 
vKteo observations in one or more spectral ranges of any such as faces 
of persona. a „d/ or audio data such as speech, voice to text conversion 
and/ or text dam such as key words or phrases from which the system ' 
us,ng fuzzy logic matchea those aspects of the current observations for 
the purpose of assessing the existence of a threat or potential threat. 

126 (NEW) A system as defined in claims 13. and 83 said centre, controller 
analyses incudes a p,ural«y of analyses logic including the use of fuzzy 
logic and comparisons accessing related databases of stored previous 
video observations in one or more spectra, ranges and specifically of the 
viable and of tbe therma, far infrared ranges of any such as faces of 
persons and/ or the environment in which those persons are obsenred 
and/ or audio data such as speech, voice to text conversion, and/ or text 



PAGE 3D/S0 " RCVD AT 4f«201l) 1:22:19 PKI pastem Daylight Tlme| ' SVR:USPT0-EF)CRF-W2S " DNIS:2?3r320 " CSD:90S T63 3SJ4 ' DURATION (mm-ss):14-J4 



04/06/10 THE 12:43 FAX 905 763 3*84_ PhD Associates Inc @}039 



data such as key words or phrases from which the system using fuzzy 
logic matches those aspects of the current observations for the purpose 
of assessing the existence of a threat or potential threat. 

127 (NEW) A system as defined in claims 15 and 83 said central controller 
analyses includes a plurality of analyses logic including the use of fuzzy 
logic and comparisons accessing "live" real-time related database 
sources of video observations in one or more spectral ranges of any 
data such as faces of persons, and/ or audio data such as speech, voice 
to text conversion, and/ or text data such as key words or phrases from 
which the system using fuzzy logic matches those aspects of the current 
observations for the purpose of assessing the existence of a threat or 
potential threat. 

128 (NEW) A system as defined in claims 15 and 83 said central controller 
analyses includes a plurality of analyses logic including the use of fuzzy 
logic and comparisons accessing "live" real-time related database 
sources of video observations in one or more spectral ranges and 
specifically of the visible and of the thermal far infrared ranges of any 
data such as faces of persons, and/ or audio data such as speech, voice 
to text conversion, and/ or text data such as key words or phrases from 
which the system using fuzzy logic matches those aspects of the current 
observations for the purpose of assessing the existence of a threat or 
potential threat. 

129 (NEW) A system as defined in claims 21 and 83 said security camera 
means system can include a plurality of such systems with video 
observations in one or more spectral ranges each of which can be 
observing the same or different said images and sounds from observed 
actions, appearances, activities, speech and movements of objects, 
animals, persons and surroundings and from the same or different 
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locations, all of which can communicate with the said central facility 
controller. 

130 (NEW) A system as defined in claims 30 and 83 said input device 
including a "closed circuit" security camera which said camera can 
observe and record said observation in a spectral range including but not 
limited to the visible, the near infrared, the infrared, the far thermal or 
heat range infrared, and the ultraviolet regions of the electromagnetic 
spectrum and microphones such that the microphones are arranged so 
that one detects sounds originating in from front of the camera and the 
other detects sounds originating from behind the camera. 

131 (NEW) A system as defined in claims 4, and 83 said input device can 
observe and record said observation in a spectral range including but not 
limited to the visible, the near infrared, the infrared, the far thermal or 
heat range infrared, and the ultraviolet regions of the electromagnetic 
spectrum, and microphones, with magnetic tape recording and computer 
database data storage means, and a plurality of sensors, coupled to the 
local controller for providing information on a plurality of parameters 
related to the local area observed said parameters including but not 
limited to observing an individual person, animal, thing or action, groups 
of said people, animals things or actions, the recording of which 
parameters the system using fuzzy logic matches those aspects of the 
current observations for the purpose of assessing the existence of a 
threat or potential threat. 

132 (NEW) A system as defined in claims 4, and 83 said input device can 
observe and record said observation in a spectral range including but not 
limited to the visible, the near infrared, the infrared, the far thermal or 
heat range infrared, and the ultraviolet regions of the electromagnetic 
spectrum, and with/ or without microphones, with magnetic tape 
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recording and computer database data storage means, and a plurality of 
sensors, coupled to the local controller for providing information on a 
plurality of parameters related to the local area observed said 
parameters including but not limited to observing groups of said people, 
specifically; audiences, crowds and/ or audience and/ or crowd actions, 
and observing individuals that are connected to and/ or part of said 
group or crowd or audience, the recording of which parameters the 
system using fuzzy logic matches those aspects of the current 
observations for the purpose of assessing the existence of a threat or 
potential threat and/ or riot and/ or public disturbance or violent behavior. 

133 (NEW) A system as defined in claims 3 and 93 said input device can 
observe and record said observation in one or more spectral range, and 
with/ or without microphones, with magnetic tape recording and 
computer database data storage means, and a plurality of sensors, 
coupled to the local controller for providing information on a plurality of 
parameters related to the local area observed said parameters 
specifically one of which is the observation of the appearance and/ or 
actions, of a person from which parameters the system using fuzzy logic 
matches those aspects of the current observations including but not 
limited to the comparison of observations in the visible and thermal 
infrared heat range for the purpose of assessing the existence, inference 
and/ or the measurement of an aura and/ or image representations of 
that person relating to said person's level of ialcohof consumption, state 
of intoxication and/ or threat or potential threat and/ or public disturbance 
or violent behavior. 

134 (NEW) A system as defined in claim 93 said input device can observe 
and record said observations in one or more spectral range, and with/ or 
without microphones, with magnetic tape recording and computer 
database data storage means, and a plurality of sensors, coupled to the 
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local controller for providing information on a plurality of parameters 
related to the local area observed said parameters one of which 
specifically is the observation of the appearance and/ or actions, of 
groups and/ or crowds of persons from which parameters the system 
using fuzzy logic matches those aspects of the current observations 
including but not limited to the comparison of observations in the visible 
and thermal infrared, for the purpose of assessing the existence, 
inference and/ or the measurement of an aura and/ or image 
representations of said persons and/ or crowds relating to the threat or 
potential threat and/ or public disturbance and/ or violent behavior and/ 
or riot or potential for riot from which said assessment, the system using 
fuzzy logic matching those aspects of the current observations, predicts 
the level of said threat, disturbance, violent behavior or riot. 

135 (NEW) A system as defined in claims 3 and 83 said camera and said 
sensors include pressure sensitive vibration and motion sensors for the 
detection of the occurrence and motion of the feet of people, animals or 
things. 

136 (NEW) A system as defined in claims 3 and 83, said sensors including 
pressure sensitive mats, pads and switches for the detection of said 
occurrences and motion of the feet of said people, animals or things. 

137 (NEW) A system as defined in claims 13 and 93 said central controller 
analysis includes a plurality of analyses logic including the use of fuzzy 
logic and comparisons accessing related databases of stored previous 
observations of the patterns, rhythm, cadence, frequency, and 
characteristics to determine and identify such foot motions and 
relationships to detect the condition, including but not limited to the 
physical, emotional, staggering, and intoxication levels of the particular 
person, animal ore thing who's said foot motion is being detected. 
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138 (NEW) A system as defined in claim 93 in which said observations and 
recordings of said faces, voices, actions, said sensors include pressure 
sensitive vibration and motion sensors for the detection of the 
occurrence and motion of the feet of people, animals or things, are 
specifically applied to the environment of drinking establishments, bars, 
nightclubs, dance clubs and entertainment venues in which said 
observations and recordings are retained and/ or exchanged with other 
establishments for the purpose of identifying said people, individuals, 
audiences, crowds and/ or their actions that could be a threat or potential 
threat and/ or riot and of public disturbance at said establishments. 

139 (NEW) A system as defined in claim 93 in which said observations and 
recordings of said faces, voices, actions, include pressure sensitive 
vibration and motion sensors for the detection of the occurrence and 
motion of the feet of people, animals or things and fuzzy logic analyses 
as apply to drinking establishments, bars, nightclubs, dance clubs, 
entertainment venues and sports venues in which said observations and 
recordings are retained and/ or exchanged with an established group or 
"POD" of similar such establishments where by patrons of one such 
"POD" establishment can be identified by other members of said POD, 
thereby allowing said members of the POD to be alerted to the identity of 
said persons, animals or things representing said threat of potential 
threat for which said members could take appropriate action against 
such persons, animals or things and/or the said threat or potential threat. 

140. (NEW) A security camera means observational system comprising: 
a) a local controller, hardware, software, firmware and fuzzy logic 
including wireless or wired communications interface for 
communicating with a central controller facility; 
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b) a camera audio and video recording device connected to said local 
controller for observing and recording and communicating to said 
central controller; 

c) a central controller with hardware, software, firmware and fuzzy 
logic for database storage and analyses of images and sounds 
from observed actions, appearances, activities, speech and 
movements of objects, animals, persons and surroundings within 
view and listening of the said camera device as communicated from 
said camera devices; 

d) a central controller with hardware, software, firmware and fuzzy 
logic for accessing both real-time data and historic data from 
related databases from sources of governments, of multimedia 
news agencies, of associated data for the purpose of conducting 
analyses for assessment and detection of threat or potential threat; 

e) an input device connected to said local controller for reading from 
or writing to magnetic or electronic storage data means and/ or a 
manually entering data means for input to said local controller; 

f) an output device associated with said focal controller for displaying 
visually or audibly or in printed means for presenting a selection of 
information and threat analysis results received from said central 
facility controller; 

g) a camera movement device and interface to the local controller for 
three axis pointing, focusing/ zooming and turn on/ off control of the 
said camera device. 

141 . (NEW) A system as defined in claim 140, said input device 
including a "closed circuit ' security camera and microphones, with 
magnetic tape recording and computer database data storage means, 
and a plurality of sensors, coupled to the local controller for providing 
information on a plurality of parameters related to the local area 
observed. 
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142. (NEW) A system as defined in claim 141 , said sensors including a 
plurality of motion, heat, sound, vibration and air quality sensors for 
detection of people, animals, things or actions that are not of the regular 
normal occurrence or could pose a threat. 

143. (NEW) A system as defined in claim 142, said actions are such as 
not to normally occur and thus are unusual and in the security sense, 
warrant examination more closely, and said threat is a thing, person, 
animal, action, sound, speech or perpetrated act that could be interpreted 
as a danger to a place, person, thing, entity, government or country. 

144. (NEW) A system as defined in claim 141 , said local controller 
including an input keyboard, key pad, touch screen manual device, a 
magnetic card or smart card reader/ writer, a display, a voice I/O 
interface, and interface means. 

145. (NEW) A system as defined in claim 141 , said local controller 
including an output device being a computer video screen and speaker 
and indicator lights and printing means, magnetic or smart card recorder 
means, for providing or indicating information regarding validity or 
acceptance of a request for entrance or access or purchase based on 
analyses by said central controller. 

146. (NEW) A system as defined in claim 140, said central controller 
monitoring and storing in databases the information communicated by the 
local controller, the data from the local camera and sensor means and 
analyzing this information and comparative information from related 
databases. 
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47. (NEW) A system as defined in claim 140, said central controller 
analyses includes a plurality of analyses logic including the use of fuzzy 
logic and comparisons accessing related databases of stored previous 
visual data such as faces of persons, and/ or audio data such as speech, 
voice to text conversion, and/ or text data such as key words or phrases 
from which the system using fuzzy logic matches those aspects of the 
current observations for the purpose of assessing the existence of a 
threat or potential threat. 

8. (NEW) A system as defined in claim 140, said central controller 
analyses includes a plurality of analyses logic including the use of fuzzy 
logic and comparisons accessing "live" real -time related database 
sources of visual data such as faces of persons, and/ or audio data such 
as speech, voice to text conversion, and/ or text data such as key words 
or phrases from which the system using fuzzy logic matches those 
aspects of the current observations for the purpose of assessing the 
existence of a threat or potential threat. 

I (NEW) A system as defined in claim 140, said central controller 
analyses includes a plurality of analyses methods including voice stress, 
emotion stress, actions and movement interpretation, image matching, 
speech/ voice to text conversions, lip reading to text conversion, deep 
extraction of information from text, facial identity matching, voice identity 
matching and personal data matching and comparisons accessing live 
real-time related database sources of visual data such as faces of 
persons, and/ or audio data such as speech, and/or text data such as key 
words or phrases from which the system using fuzzy logic matches those 
aspects of the current observations for the purpose of identifying people, 
animals, things, actions, speech, and stress that indicate the existence of 
a threat or potential of a threat. 



PAGE 46/50 * RCVD AT 4/6/2D10 1:22:19 PM pastern Daylight TimeJ * SVR:USPTO-EFXRF^/25 * DNIS:2737320 * CSID:905 763 3884 * DURATION (mm-ss):14-34 



04/06/10 TUE 12:45 FAX 905 763 3884 



PhD Associates Inc 



©047 



3. (NEW) A system as defined in claim 140, said central controller can 
communicate to the local controller of said camera means commands for 
said pointing focusing/ zooming, viewing direction, viewing zoom 
magnification and turning on/ off camera controls. 

I . (NEW) A system as defined in claim 140, said local controller 
incorporates part or all of said central controller functions and capabilities 
such that the said camera means could be a stand alone complete 
Camera System means utilizing microelectronic designs, circuitry 
miniaturization and solid state memory systems. 

(NEW) A system as defined in claim 140, said local controller 
utilizing fuzzy logic and microelectronic designs, circuitry miniaturization 
and solid state memory systems, incorporates part or much of the said 
central controller functions and capabilities such that the said camera 
means becomes more independent from the central controller and 
capable of conducting much of the analyses and response function 
directly. 



(NEW) A security camera means observational system comprising: 

a. a local controller, hardware, software, firmware and fuzzy logic 
including wireless or wired communications interface for 
communicating with a central controller facility; 

b. a camera audio and video recording device connected to said local 
controller for observing and recording and communicating to said 
central controller; 

c. a central controller with hardware, software, firmware and fuzzy 
logic for database storage and analyses of images and sounds 
from observed actions, appearances, activities, speech and 
movements of objects, animals, persons and surroundings within 
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view and listening of the said camera device as communicated from 
said camera devices; 

d. a central controller with hardware, software, firmware and fuzzy 
logic for accessing both real-time data and historic data from 
related databases from sources of governments, of multimedia 
news agencies, of associated data for the purpose of conducting 
analyses for assessment and detection of threat or potential threat; 

e. an input device connected to said local controller for reading from 
or writing to magnetic or electronic storage data means and/ or a 
manually entering data means for input to said local controller; 

t an output device associated with said local controller for displaying 
visually or audibly or in printed means for presenting a selection of 
information and threat analysis results received from said central 
facility controller; 

g. a camera movement device and interface to the local controller for 
three axis pointing, focusing/ zooming and turn on/ off control of the 
said camera device. 

154. (NEW) A system as defined in claim 153, said central controller 
analyses includes a plurality of analyses logic including the use of fuzzy 
logic and comparisons accessing related databases of stored previous 
visual data such as faces of persons, and/ or audio data such as speech, 
voice to text conversion, and/ or text data such as key words or phrases 
from which the system using fuzzy logic matches those aspects of the 
current observations for the purpose of assessing the level of sobriety 
due to drug or alcohol use and the existence of a resulting threat or 
potential threat. 

155. (NEW) A system as defined in claim 153, said central controller 
analyses includes a plurality of analyses methods including voice stress, 
emotion stress, actions and movement interpretation, image matching, 
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speech/ voice to text conversions, lip reading to text conversion, deep 
extraction of information from text, facial identity matching, voice identity 
matching and personal data matching and comparisons accessing stored 
related database sources of stored previously of visual data such as 
faces of persons, and/ or audio data such as speech, and/ or text data 
such as key words or phrases from which the system using fuzzy logic 
matches those aspects of the current observations for the purpose of 
identifying people, animals, things, actions, speech, and stress that 
indicate the level of sobriety due to drug or alcohol use and the existence 
of a resulting threat or potential of a threat. 

1 56. (NEW) A system as defined in claim 1 53, for the detection and 
analyzes of alcohol or drug intoxication or impairment of a person or 
persons for the detection of person or persons as a potential threat to the 
public and/or to property and/or to themselves. 

157. (NEW) A system as defined in claim 156, said analyzes 
determining a level of intoxication or impairment so as to assign a 
numerical value to said level, as an indication within a standard set of 
said levels as to the said intoxication or impairment of the person or 
persons similar to the application of breathalyzer standards used to 
describe the level of alcohol intoxication as determined by chemical 
measure of the breath of a person. 

1 58. (NEW) A system as defined in claim 1 53 for the detection of health 
related problems such as heart attack, diabetic or epileptic seizure, drug 
use or abuse, drunkenness and the like. 

1 59. (NEW) A system as defined in claim 140, said input device 
including a camera and/ or a "closed circuit" security camera which said 
camera can observe and record said observation in a spectral range 
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including but not limited to the visible, the near infrared, the infrared, the 
far thermal or heat range infrared, and the ultraviolet regions of the 
electromagnetic spectrum, and microphones, with magnetic tape 
recording and computer database data storage means, and a plurality of 
sensors, coupled to the local controller for providing information on a 
plurality of parameters related to the local area observed. 
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